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ABSTRACT  tion  are  given  in  Table  II. 

This  paper  presents  the  use  of  computer  simulation  A feedback  controller  is  used  to  modulate  the  rate 

to  test  the  application  of  the  lnstrumental-vari-  of  cooling  water  to  the  jacket  so  as  to  maintain  the 

able  method  of  process  identification  to  the  adap-  reactor  temperature  at  its  set-point  or  desired 

tive  temperature  control  of  a chemical  reactor.  value.  Because  Che  reactor  is  highly  nonlinear, 

The  method  is  shown  to  be  stable  when  used  in  a adjustment  of  the  controller  parameters  to  achieve 

closed-loop  configuration  to  update  the  parameters  acceptable  control  at  one  operating  level  does  not 

of  a discrete  linear  model  of  the  reactor.  The  guarantee  acceptable  control  at  other  levels.  Vari- 

updated  parameters  are  used  to  adjust  the  param-  atlons  in  reactant  rate,  inlet  temperature  and  tem- 

eters  of  a feedback  control  algorithm.  Dynamic  perature  set-point  cause  the  dynamic  characteristics 

information  is  generated  by  aperiodic  changes  in  of  the  reactor  to  change.  Hence  the  need  for  adap- 

control  set-point.  Unmeasured  disturbances  are  tive  control, 

shown  to  deteriorate  the  parameter  estimates,  but 

without  catastrophic  effects.  THE  DISCRETE  LINEAR  MODEL 


INTRODUCTION  In  practice,  the  nonlinear  model  equations  presented 

in  Table  I,  and  the  parameter  values  of  Table  II  are 

Today,  with  the  aid  of  an  on-line  digital  computer,  either  unavailable  or  too  complex  for  use  in  con- 
it is  possible  to  use  an  empirical  model  to  repre-  t roller  design.  Even  this  simplified  model  must  be 

sent  a non-linear  plant  in  a sequential  manner.  linearized  since  the  most  common  controller  design 

Specifically,  a low-order  linear  model  is  selected  methods  are  based  almost  exclusively  on  linear 

to  represent  the  dynamic  system.  By  use  of  the  models.  In  addition,  the  common  proportional- 

proper  estimation  algorithm,  the  computer  is  able  integral  (PI)  and  proportional-integral-derivative 

to  produce  updated  parameter  estimates  for  the  (PID)  controllers  used  in  industry  are  based  on 

empirical  model  at  each  sample  Instant.  With  this  first  and  second  order  models,  respectively  [2]. 

quasi-linearization  procedure  it  is  now  feasible 

for  the  engineer  to  characterize  the  dynamics  of  Since  the  identification  and  control  methods  studied 

his  process  sufficiently  to  be  able  to  apply  such  here  are  usually  implemented  on  digital  control  corn- 

advanced  control  techniques  as  the  self-adaptive  puters,  the  most  convenient  model  is  a difference 

strategy.  Because  self-adaptive  process  control  is  equation  relating  plant  output  (temperature)  to 
a relatively  untried  concept,  a number  of  questions  input  (cooling  water  rate).  The  second-order  equa- 


must  be  answered  before  the  technique  can  be  even 
considered  for  field  implementation.  Computer 
simulation  offers  a safe  and  relatively  (inexpensive 
approach  to  obtaining  the  answers.  This  paper  is 
an  attempt  to  demonstrate  Its  usefulness. 

DEFINITION  OF  THE  PROBLEM 

The  jacketed  stirred-tank  chemical  reactor  shown  in 
Figure  1 Is  adapted  from  an  example  presented  by 
Chiu  [1],  The  equations  describing  this  system  are 
shown  in  Table  I and  were  derived  by  making 
unsteady-state  mass  balance  on  the  reactant,  and 
energy  balances  on  the  reacting  mixture  and  the 
Jacket.  This  dynamic  model  is  subject  to  the 
assumptions  of  perfect  mixing,  constant  physical 
properties,  constant  holdup  volumes  and  heat  trans- 
fer coefficient,  and  negligible  heat  losses.  The 
values  of  the  model  parameters  used  in  the  simula- 


tion used  here  is  of  the  form: 


alyt-l+a2yt-2+i)lut-M-l+b2Ut-M-2+C 


where  y ” TR  - Tg 


Note  that  the  linearized  nature  of  the  model  demands 
that  the  input  and  output  variables  be  expressed  in 
terms  of  deviations^  from  some  ope-atlng  values, 
denoted  by  TR  and  Wc.  The  constant  parameter  C is 
included  to  account  for  nonzero-mean  unmeasured  dis- 
turbances and  for  the  shifting  of  the  operating 
point  from  the  initial  values.  In  general,  best 
results  are  obtained  when  C is  small. 

A' 

Since  the  second-order  model  is  selected  for  use  as,A 
an  empirical  representation  of  the  reactor,  the  only 


ocher  a priori  information  necessary  Is  the  dead 
time  (transportation  lag  or  time  delay)  parameter  M. 
Although  the  reactor  Is  a lumped  system  with  no  dead 
time,  model  fit  can  be  Improved  by  allowing  some 
pseudo-dead  time  to  account  for  the  fact  that  a 
second-order  equat ' ,n  is  used  to  model  a higher 
(third)  order  system.  In  this  case  a dead-time 
equal  to  the  sample  time  of  one  minute  was  chosen, 
based  on  the  open-loop  response  of  the  simulated 
reactor. 

ESTIMATION  BY  INSTRUMENTAL  VARIABLE 

A detailed  discussion  of  Instrumental  Variable 
regression  is  the  subject  of  a previous  presentation 
by  these  authors  [3J.  This  method  is  chosen  to 
estimate  the  parameters  of  Equation  1 because  it 
maintains  the  simplicity  of  least-squares  regression 
while  avoiding  estimation  bias  due  to  measurement 
noise. 

Equation  1 can  be  written  in  the  following  vector 
form: 


CLOSED-LOOP  ESTIMATION 


Closed-loop  estimation  studies  were  performed  for 
the  simple  feedback  control  loop  with  a PID  con- 
troller and  for  the  adaptive  control  configuration 
employing  a Dahlln  synthesis  controller  [4]  The 
reactor  in  the  closed-loop  configuration  was  forced 
with  a square-wave  signal  on  the  set  point  of  the 
temperature  controller. 


The  PID  control  algorithm  is  given  by  the  equation 
[51: 


ut-l+iCc[et-et-l^t4F(et-2et-l+et-2)1 


(7) 


where  efc  ■ R£  - y£ 

The  controller  parameters  given  by  Chiu  (61  for  this 
reactor  are:  Kc  ■ -632.6  lbs/min-°F,  T^  * 20.9  min, 

Td  - 1.8  min. 

ADAPTIVE  CONTROL 


♦x, 


t-1 


where  4 


T 

C-1 


l*la2blb2Cl 

tyt-lyt-2Ut-M-lUt-M-2 


1] 


(2)  For  adaptive  control,  the  Dahlln  algorithm  [41 

offers  the  advantage  of  allowing  direct  computation 
of  the  controller  parameters  from  the  parameters  of 
Equation  1,  the  discrete  model,  provided  that  the 
estimation  sample  time  is  the  same  as  the  control 
sample  time.  The  algorithm  equation  is  given  by: 


Because  the  measured  output  of  the  plant,  y,  is 
corrupted  by  measurement  noise,  the  presence  of  past 
values  of  the  output  in  the  vector  of  exogenous 
variables,  x,  causes  bias  on  the  least-squares  esti- 
mates of  the  model  parameters.  This  bias  is  mini- 
mized by  generating  a vector  of  Instruments, 
containing  the  output  of  the  model  equation: 


et  - »’t-i  (3) 

where  - [5t_iet-2ut-M-lut-M-21] 


The  vector  of  parameter  estimates,  $,  is  then  com- 
puted by  the  following  recursive  formulas: 

*t+i  ’ •t+(yt+rVt)  i1+ztpt/t-i*trl*tpt/t-i  <*> 


pt/t-i  ' pt-i  + D 


(5) 


pt  “ pt/t-rpt/t-ixttl+ztpt/t-ixt1  ztpt/t-i  (6) 


where  ?t/t-l  18  the  projection  of  the  weighting 
matrix  P at  time  t,  based  on  observations  up  to  and 
including  yt_x,  and  D is  a lower  bound  on  P. 

Matrix  D controls  the  parameter  tracking  capability 
of  the  IV  estimator.  If  D • 0,  matrix  P decreases 
with  time  until,  eventually,  new  samples  have 
little  effect  on  the  parameter  estimates..  Each 
nonzero  term  of  D sets  a lower  bound  on  the  corres- 
ponding term  of  P,  allowing  the  algorithm  to  track 
parameter  variations.  Matrix  D is  usually  chosen 
to  be  diagonal,  with  each  diagonal  term  correspond- 
ing to  a different  model  parameter. 


Ut  - 8oet+8iet-l+82et-2+hlUt-l+h2Ut-2  (8) 

with  gQ  - Q/bj  g:  - -ajQ/bj  e2  * -a2Q/b1 

hl  * (bl  ‘ b2)/bl  h2  “ b2/bl 
“T/B 

where  Q “ (1-e  B)  is  a tuning  parameter  that 
determines  the  tightness  of  control.  For  this 
study,  the  value  of  B ■ 2 was  chosen. 

Aperiodic  Input 

It  is  of  considerable  Interest  to  Investigate  the 
use  of  an  aperiodic  forcing  function  for  the  adap- 
tive scheme  because  in  many  cases  set-point  changes 
do  not  occur  often  enough  in  the  course  of  normal 
process  operation.  In  this  regulatory  situation, 
it  is  desirable  to  hold  process  upsets  to  a minimum. 
At  the  same  time,  it  must  be  realized  that  the  pro- 
cess must  be  driven  enough  to  excite  all  nodes  of 
the  system.  Examination  of  some  of  the  results  of 
this  study  suggested  that  estimation  could  be  accom- 
plished by  a series  of  two  symmetric  pulses,  one  up 
and  one  down,  after  which  the  set-point  is  returned 
to  its  normal  operating  value. 

Dynamic  Estimation 

For  the  static  estimator,  the  lower  bcund  matrix  D 
is  set  to  zero.  Under  these  conditions,  the  IV 
algorithm  "remembers''  all  of  the  samples  from  the 
start  and  thus  averages  the  up  and  down  changes  in 
the  forcing  function.  By  introduction  of  D ele- 
ments, the  memory  of  the  algorithm  is  shortened 
accordingly  and  the  estimator  can  be  made  to  track 
the  parameter  values  associated  with  the  latest 
change  in  set-point.  This  tracking  may  be  more 


_ 


.2 . .. 


desirable  for  • particular  application  than  tha 
everage  raault  obtained  with  0 • 0.  Thla  point  la 
llluatratad  In  Figure  2 tor  tha  “Vj  controller  and 
In  Flgura  3 for  tha  adaptive  a gy  aaploylng  tha 
Dahl In  control  algorltha.  That*  '~amm  also  a how 
tha  affact  of  a atap  disturbance  a j at  tha  200th 
sample  Instant . 

Flgura  2 shows  tha  affact  of  tha  aparlodlc  taat 
Input  on  tha  eat  1m t lor  of  paraattar  b(  which  la 
proportional  to  tha  procaaa  gain.  Theultlal 
paranatara  for  thaaa  flguras  wars  obtained  froa  the 
results  of  tha  static  satlaator.  In  tha  present 
case,  PQ  wm  chosen  to  be  zero  which  Indicates  that 
the  paranatara  are  known  to  be  accurate.  For  the 
static  astlaator  (l.e.,  D • 0)  Pc  • 0 freezes  the 
estimates  regardless  of  any  system  Inputs  or  dis- 
turbances. However,  with  nonzaro  elements  In  D, 
the  algorithm  la  free  to  track  even  with  P0  - 0. 

Tha  diagonal  elements  of  D ware  chosen  to  be  the 
corresponding  final  values  of  tha  weighting  matrix 
from  static  astlaator  runs.  Following  the  aperio- 
dic Input,  tha  set  point  Is  first  Increased  by  2*F 
and  the  controller  responds  by  reducing  the  cooling 
water  rate  ut.  The  estimator  currectly  predicts 
that  the  process  gain  has  Increased  and  this  Is 
reflected  by  the  Increase  In  absolute  value  of  the 
parameter  b^.  In  other  words,  the  estimator  was 
Initialized  with  the  "average"  model  and  correctly 
tracked  the  parameter  values  for  a set-point 
Increase  from  the  new  Information  received.  The 
other  two  steps  of  the  aperiodic  Input  follow  the 
same  reasoning.  The  initial  values  of  the  control- 
ler settings  for  the  adaptive  and  the  non-adaptlve 
controllers  were  the  sane . These  values  were 
obtained  from  the  Dahlln  control  law  using  the 
Initial  paraMtcr  set. 

The  desire  to  maintain  a stable  estimation  algo- 
rithm In  the  face  of  large  and  abrupt  load  changes 
is  generally  In  opposition  with  the  desire  to  track 
system  parameters.  This  subject  is  Introduced  here 
to  point  out  the  consideration  that  must  be  taken 
for  the  selection  of  the  D matrix.  At  the  200th 
sample,  the  flow  of  reactants  to  ihe  reactor  was 
changed  from  F ■ 16.7  to  F ■ 15.0  ft^/mln.  Figures 
2 and  3 Illustrate  this  disturbance  and  Its  effects 
for  the  adaptive  and  the  non-adaptlve  systems.  The 
Important  result  of  this  experiment  Is  that  the 
dynamic  estimation  algorithm  remains  stable  for  the 
adaptive  configuration  even  with  abrupt  load 
changes.  It  is  conceded  that  much  work  remains  to 
be  done  In  this  area,  but  at  the  same  time,  it  is 
felt  that  results  presented  here  indicate  that  the 
dynamic  IV  estimation  approach  holds  considerable 
promise. 

SUMMARY  AND  CONCLUSION 

This  paper  has  dealt  with  the  all  important  feature 
of  an  on-line  estimation  method  applied  In  the  pro- 
cess Industry  - that  it  be  capable  of  representing 
non-llnear  dynamics  with  low-order  linear  models. 

An  application  to  a Jacketed  chemical  reactor  was 
presented  with  a discussion  on  the  specific  non- 
linear behavior.  While  the  open-loop  estimation 
performance  was  found  to  be  relatively  independent 
of  the  amplitude  of  the  forcing  function,  the 
closed-loop  performance  was  shown  to  be  more  sensi- 


tive to  Input  asg>litude,  but  for  this  example  appli- 
cation, the  difference  was  not  significant.  Finally, 
evidence  was  given  that  the  closed-loop  reactor 
system  could  be  estimated  by  use  of  an  aperiodic 
test  pulse  used  to  minimize  disturbance  to  the 
system. 
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NOTATION 

A reactor  heat  transfer  area,  sq.  ft. 

a model  output  parameters 

b model  input  parameters 

C model  bias  parameter 

C reactant  concentration,  lb/cu.  ft. 

CV  inlet  reactant  concentration,  lb/cu.  ft. 

C*  specific  heat,  Btu/lb  *F 

D1*  lower  bound  matrix  (5x5) 

E activation  energy,  °R 

e control  algorithm  error,  °F 

F reactant  flow  rate,  cu.  ft/min. 

AH  heat  of  reaction,  Btu/lb 

Kc  controller  gain 

k reaction  rate  coefficient,  cu.  ft./lb-min. 
k reaction  rate  parameter,  cu.  ft./lb-min. 

M dead-time 

M jacket  mass,  lb  or  Btu/'F 

P weighting  matrix  (5x5) 

Q Dahlln  controller  parameter 

R control  set-point,  °F 

T sample  time,  min. 

Tc  jacket  temperature,  °F 

Tj  controller  derivative  time,  min. 

controller  Integral  time,  min. 

T reactant  inlet  temperature,  *F 

Tr  reactor  temperature,  °F 

Tw  water  inlet  temperature,  "F 

t time,  min, time  Index 

U heat  transfer  coefficient,  Btu/min-sq.  ft.  °F 
u input  (deviation)  variable,  lbs/min. 

V reactor  hold  up,  cu.  ft. 

Wc  cooling  water  rate,  lbs/min 

X input  signal  amplitude,  lbs/min 

x vector  of  endogeneous  variables,  (5x1) 

y output  (deviation)  variable,  °F 

z vector  of  Instrumental  variables  (5x1) 

B Dahlln  closed-loop  time  constant,  min. 

X Input  signal  period 

if  vector  of  model  parameters  (1x5) 

£ model  output  variable,  *F 

p reactant  density,  lb/cu.  ft. 
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Figure  1.  The  Jacketed  Chemical  Reactor 
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Table  II 

Initial  Conditions  and  System  Parameters 


Initial  Conditions 


C,  - 3.6  lbs/ft 
A 

T - 190°F 
R 

T - 120"F 
c 

System  Parameters 


Initial  Value 


C,  - 9 lbs/ftJ 
Ao 


W - 1074  lbs /min 
c 


F - 16.7  ftJ/mln  T - 80°F 
w 

AH  - 870  Btu/lb  C - 0.9  Btu/lb-°F 
P 

V - 250  ft3  UA  » 600  Btu/min-'F 


UA  “ 600  Btu/mln-'F 
E - 2560°R 


« -0.3L 
o>  - 


Time,  Minutes 


Figure  2.  Time  series  showing  the  effect  of  an 
aperiodic  set  point  function  and  a 
step  disturbance  on  the  dynamic  IV 
estimation  of  parameter  b^  for  the 
PID  controller 
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Time  series  showing  the  effect  of 
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